DUEL: A Multi-lingual Multimodal Dialogue Corpus for Disfluency, Exclamations and Laughter
نویسندگان
چکیده
We present the DUEL corpus, consisting of 24 hours of natural, face-to-face, loosely task-directed dialogue in German, French and Mandarin Chinese. The corpus is uniquely positioned as a cross-linguistic, multimodal dialogue resource controlled for domain. DUEL includes audio, video and body tracking data and is transcribed and annotated for disfluency, laughter and exclamations.
منابع مشابه
Exploring the Body and Head Kinematics of Laughter, Filled Pauses and Breaths
We present ongoing work in the DUEL project, which focuses on the study of disfluencies, exclamations, and laughter in dialogue. Here we focus on the multimodal aspects of disfluent vocalizations, namely laughter and laughed speech, filled pauses, and breathing noises. We exemplify these phenomena in the rich multimodal Dream Apartment Corpus, a natural dialogue corpus, which, in addition to co...
متن کاملTTR for Natural Language Semantics ?
? This work was supported in part by Vetenskapsr̊adet project 2009-1569, Semantic analysis of interaction and coordination in dialogue (SAICD), by the Lab(oratory of )Ex(cellence)-EFL (ANR/CGI), and by the Disfluency, Exclamations, and Laughter in Dialogue (DUEL) project within the projets franco-allemand en sciences humaines et sociales funded by the ANR and the DFG. We are grateful for comment...
متن کاملA comparison of disfluency distribution in a unimodal and a multimodal speech interface
In this paper, we compare the distribution of disfluencies in two human–computer dialogue corpora. One corpus consists of unimodal travel booking dialogues, which were recorded over the telephone. In this unimodal system, all components except the speech recognition were authentic. The other corpus was collected using a semi-simulated multi-modal dialogue system with an animated talking agent a...
متن کاملExploring the Role of Laughter in Multiparty Conversation
Conversation is widely studied through corpus analysis, often concentrating on ‘task-based’ interactions such as information gap activities (map-tasks [1], spot the difference [2], ranking items [3]) and real or staged business meetings [4], [5]. This task-based dialogue (on which spoken dialogue technology is based [6]) relies heavily on verbal information exchange. However, the immediate task...
متن کاملDisfluency and Laughter Annotation in a Light-weight Dialogue Mark-up Protocol
Despite a great deal of research effort, disfluency and laughter annotation is still an unsolved problem, both in terms of consensus for a general applicable system, and in terms of annotation agreement metrics. In this paper we present a new annotation scheme within a light-weight mark-up for spontaneous speech. We show, despite the low overhead required for understanding the annotation protoc...
متن کامل